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BACKGROUND OF THE INVENTION 

5 1 , Field Of the Invention 

The subject matter disclosed generally relates to the 
field of robotics. 

2 , Background Information 

There is a growing need to provide remote health care 

10 to patients that have a variety of ailments ranging from 
Alzheimers to stress disorders. To minimize costs it is 
desirable to provide home care for such patients. Home 
care typically requires a periodic visit by a health care 
provider such as a nurse or some type of assistant. Due to 

15 financial and/or staffing issues the health care provider 
may not be there when the patient needs some type of 
assistance. Additionally, existing staff must be 
continuously trained, which can create a burden on training 
personnel . It would be desirable to provide a system that 
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would allow a health care provider to remotely care for a 
patient without being physically present. 

Robots have been used in a variety of applications 
ranging from remote control of hazardous material to 
5 assisting in the performance of surgery. For example, U.S. 
Patent No. 5,762,458 issued to Wang et al . discloses a 
system that allows a surgeon to perform minimally invasive 
medical procedures through the use of robotically 
controlled instruments. One of the robotic arms in the 

10 Wang system moves an endoscope which has a camera that 
allows a surgeon to view a surgical area of a patient. 

Tele-robots such as hazardous waste handlers and bomb 
detectors may contain a camera that allows the operator to 
view the remote site. Canadian Pat. No. 2289697 issued to 

15 Treviranus, et al . discloses a teleconferencing platform 
.that has both a camera and a monitor. The platform 
includes mechanisms to both pivot and raise the camera and 
monitor. The teleconferencing platform disclosed in the 
Canadian patent is stationary and cannot move about a 

20 building. 
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Publication Application No. US-2003-0050233-A1 
discloses a remote robotic system wherein a plurality of 
remote stations can control a plurality of robotic arms 
used to perform a minimally invasive medical procedure. 
5 Each remote station can receive a video image provided by 
the endoscope inserted into the patient. Such a system is 
also being developed by Computer Motion, Inc. under the 
name SOCRATES. The remote stations are linked to the 
robotic system by a dedicated communication link. 
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PPTBF SUMMARY OF THE IMVEllTION 
A mobile robotic system that includes a mobile robot 
ooupled to a first remote station and a second remote 
station. Movement of the mobile robot is controlled 
5 through the first remote station. The mobile robot has a 
camera that captures a video image. The first and second 
remote stations both receive the video image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figures 1 is an illustration of a robotic system; 
Figure 2 is a schematic of an electrical system of a 
robot ; 

Figure 3 is a further schematic of the electrical 
system of the robots- 
Figure 4 is side view of the robot; 

Figure 5 is a top perspective view of a holonomic 
platform of the robot; 

Figure 6 is a side perspective view of a roller 
assembly of the holonomic platform; 

Figure 7 is a bottom perspective view showing a 
pedestal assembly of the robot; 

Figure 8 is a sectional view showing an actuator of the 
pedestal assembly; 

Figure 9 is a schematic of a robotic system wherein 
multiple remote stations are coupled to the robot; 

Figure 10 is a side view of a robot head. 
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pp;T,:,TT.T^.rt DESCRIPTION 

Disclosed is a robotic system that includes a mobile 
.obot linked to a plurality of remote stations. The robot 
provides both audio and visual information to the stations. 
5 one of the remote stations, a primary station, may control 
the robot While receiving and providing audio and visual 
information with the remote controlled robot. The other 
stations, the secondary stations, may also receive the 
audio and visual information transmitted between the robot 
10 and the primary station. This allows operators of the 
secondary stations to observe and be trained through the 
.obot and primary station. Such an approach may reduce the 
amount of travel re<juired to train personnel. For example, 
a nurse may instruct other personnel on how to care for a 
15 special need patient. The secondary station operators can 
Observe a training season through the "eyes" of the robot. 

Referring to the drawings more particularly by 
reference numbers, Figure 1 shows a robotic system 10. The 
.obotic system 10 includes a robot 12, a base station 14 
30 and a plurality Of remote control stations 16. Each remote 
control station 16 may be coupled to the base station 14 
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through a network 18. By way of example, the network 18 
may be either a packet switched network such as the 
Internet, or a circuit switched network such has a Public 
Switched Telephone Network (PSTN) or other broadband 
5 system. The base station 14 may be coupled to the network 
18 by a modem 20 or other broadband network interface 
device . 

Each remote control station 16 may include a computer 
22 that has a monitor 24, a camera 26, a microphone 28 and 

10 a speaker 30, The computer 22 may also contain an input 
device 32 such as a joystick or a mouse. Each control 
station 16 is typically located in a place that is remote 
from the robot 12. Although only one robot 12 is shown, it 
is to be understood that the system 10 may have a plurality 

15 of robots 12, In general any number of robots 12 may be 
controlled by any number of remote stations. For example, 
one remote station 16 may be coupled to a plurality of 
robots 12, or one robot 12 may be coupled to a plurality of 
remote stations 16, 

20 The robot 12 includes a movement platform 34 that is 

attached to a robot housing 36. Also attached to the robot 

Atty. Docket No. 157438-0007 6 BJY/wrj 

Express Mail Label No. EL696985172US 

1005143 



housing 36 are a camera 38, a monitor 40, a microphone(s) 
42 and a speaker 44. The microphone 42 and speaker 30 may 
create a stereophonic sound. The robot 12 may also have an 
antenna 45 that is wirelessly coupled to an antenna 46 o£ 
the base station 14. The system 10 allows a user at the 
remote control station 16 to move the robot 12 through the 
input device 32. The robot camera 38 is coupled to the 
remote monitor 24 so that a user at the remote station 16 
can view a patient. Likewise, the robot monitor 40 is 
coupled to the remote camera 26 so that the patient can 
view the user. The microphones 28 and 42, and speakers 30 
and 44, allow for audible co^mmication between the patient 
and the user. The robot 12 may further have a handle 48 
that can be rotated to a down position which allows someone 
to manually push or pull the robot 12 . 

Each remote station con,>uter 22 may operate Microsoft 
OS software and WINDOWS XP or other operating systems such 
as LINTK. The remote computer 22 may also operate a video 
driver, a camera driver, an audio driver and a joystick 
0 driver. The video images may be transmitted and received 
with compression software such as MPEG CODEC. 

BJY/wrj 
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Figures 2 and 3 show an embodiment of the robot 12. 
The robot 12 may include a high level control system 50 and 
a low level control system 52. The high level control 
system 50 may include a processor 54 that is connected to a 
bus 56. The bus is coupled to the camera 38 by an 
input/output (I/O) port 58, and to the monitor 40 by a 
serial output port 60 and a VGA driver 62. The monitor 40 
™ay include a touchscreen function that allows the patient 
to enter input by touching the monitor screen. . 

■ The speaker 44 is coupled to the bus 56 by a digital to 
analog converter 64. The microphone 42 is coupled to the 
bus 56 by an analog to digital converter 66, The high 
level controller 50 may also contain random access memory 
device 68, a non-volatile RAM device 70 and a mass 
; storage device 72 that are all coupled to the bus 62. The 
™ass storage device 72 may contain medical files of the 
patient that can be accessed by the user at the remote 
control station 16. For example, the mass storage device 
72 may contain a picture of the patient. The user. 
0 particularly a health care provider, can recall the old 
picture and make a side by side comparison on the monitor 
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24 with a present video image of the patient provided by 
the camera 38. The robot antennae 45 may be coupled to a 
wireless transceiver 74. By way of example, the 
transceiver 74 may transmit and receive information in 
accordance with IEEE 802.11b. 

The controller 54 may operate with a LINUX OS operating 
system. The controller 54 may also operate MS WINDOWS 
along with video, camera and audio drivers for 
communication with the remote control station 16. Video 
information may be transceived using MPEG CODEC compression 
techniques. The software may allow the user to send e-mail 
to the patient and vice versa, or allow the patient to 
access the Internet. In general the high level controller 
50 operates to control the communication between the robot 
12 and the remote control station 16. 

The high level controller 50 may be linked to the low 
level controller 52 by serial ports 76 and 78. The low 
level controller 52 includes a processor 80 that is coupled 
to a RAM device 82 and non-volatile RAM device 84 by a bus 
0 86. The robot 12 contains a plurality of motors 88 and 
motor encoders 90. The encoders 90 provide feedback 

BJY/wrj 
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information regarding the output of the motors 88. The 
motors 88 can be coupled to the bus 86 by a digital to 
analog converter 92 and a driver amplifier 94. The 
encoders 90 can be coupled to the bus 86 by a decoder 96. 
5 The robot 12 also has a number of proximity sensors 98 (see 
also Fig. 1) . The position sensors 98 can be coupled to 
the bus 86 by a signal conditioning circuit 100 and an 
analog to digital converter 102. 

The low level controller 52 runs software routines that 

10 mechanically actuate the robot 12. For example, the low 
level controller 52 provides instructions to actuate the 
movement platform to move the robot 12 . The low level 
controller 52 may receive movement instructions from the 
high level controller 50. The movement instructions may be 

15 received as movement commands from the remote control 

station. Although two controllers are shown, it is to be 
understood that the robot 12 may have one controller 
controlling the high and low level functions. 

The various electrical devices of the robot 12 may be 

20 powered by a battery (ies) 104. The battery 104 may be 

recharged by a battery recharger station 106 (see also Fig. 
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1) . The low level controller 52 may include a battery 
control circuit 108 that senses the power level of the 
battery 104. The low level controller S2 can sense when 
the power falls below a threshold and then send a message 
to the high level controller 50. The high level controller 
50 nay include a power management software routine that 
causes the robot 12 to move so that the battery 104 is 
coupled to the recharger 106 when the battery power falls 
below a threshold value. Alternatively, the user can 
direct the robot 12 to the battery recharger 106. 
Additionally, the battery 104 may be replaced or the robot 
X2 may be coupled to a wall power outlet by an electrical 

cord (not shown) . 

Figure 4 shows an enO^odiment of the robot 12 . The 
robot 12 may include a holonomic platform 110 that is 
attached to a robot housing 112. The holonomic platform 

. . = H»orees of freedom to allow the robot 12 

110 provides three degrees oi 

to move in any direction. 

The robot 12 may have an pedestal assembly 114 that 
0 supports the camera 3B and the monitor 40. The pedestal 
asse^ly 114 may have two degrees of freedom so that the 

BJY/wrj 
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camera 26 and monitor 24 can be swiveled and pivoted as 

indicated by the arrows. 

AS shown in Figure 5 the holonomic platform 110 may 
include three roller asse^lies 120 that are mounted to a 
base plate 121. The roller assemblies 120 are typically 
e^ally spaced about the platform 110 and allow for 
movement in any direction, although it is to be understood 
that the assemblies may not be equally spaced. 

The robot housing 112 may include a bumper 122 . The 
bumper 122 may be coupled to optical position sensors 123 
that detect when the bumper 122 has engaged an object. 
After engagement with the object the robot can determine 
the direction of contact and prevent further movement into 
the object. 

Figure 6 shows an embodiment of a roller assembly 120. 
Each asse«i>ly 120 may include a drive ball 124 that is 
driven by a pair of transmission rollers 126. The assembly 
120 may include a retainer ring 128 and a plurality of 
bushings 130 that captures and allows the ball 124 to 
0 rotate in an k and y direction but prevents movement in a z 
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direction. The assembly also holds the ball under the 
transmission rollers 126, 

The transmission rollers 126 are coupled to a motor 
assembly 132. The assembly 132 corresponds to the motor 88 
5 shown in Fig. 3. The motor assembly 132 includes an output 
pulley 134 attached to a motor 136. The output pulley 134 
is coupled to a pair of ball pulleys 138 by a drive belt 
140. The ball pulleys 138 are each attached to a 
transmission bracket 142. The transmission rollers 126 are 

10 attached to the transmission brackets 142. 

Rotation of the output pulley 134 rotates the ball 
pulleys 138. Rotation of the ball pulleys 138 causes the 
transmission rollers 126 to rotate and spin the ball 124 
through frictional forces. Spinning the ball 124 will move 

15 the robot 12. The transmission rollers 126 are constructed 
to always be in contact with the drive ball 124. The 
brackets 142 allow the transmission rollers 126 to freely 
spin and allow orthogonal directional passive movement of 
124 when one of the other roller assemblies 120 is driving 

20 and moving the robot 12. 
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AS shovm in Figure 7, the pedestal assembly 114 may . 
include a motor 150 that is coupled to a gear 152 by a belt 
154. The gear 152 is attached to a shaft 156. The shaft 
156 is attached to an arm 158 that is coupled to the camera 
38 and monitor 40 by a bracket 160. Activation of the 
„otor 150 rotates the gear 152 and sleeve 156, and causes 
the camera 38 and monitor 40 to swivel (see also Fig. 4) as 
indicated by the arrows 4 . 

AS shown in Figure 8, the assembly 114 may further 
include a tilt motor 162 within the arm 158 that can cause 
the monitor 40 and camera 38 to pivot as indicated by the 
arrows 5. The tilt motor 162 may rotate a worm 164 that 
rotates a worm gear 166. The pin 168 is rigidly attached 
to both the worm gear 166 and the bracket 160 so that 
rotation of the gear 166 pivots the camera 38 and the 
monitor 40. The camera 38 may also include a zoom feature 
to provide yet another degree of freedom for the operator. 

in operation, the robot 12 may be placed in a home or 
facility where one or more patients are to be monitored 
0 and/or assisted. The facility may be a hospital or a 

residential care facility. By way of example, the robot 1 
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„ay be placed in a home where a health care provider may 
monitor and/or assist the patient. Likewise, a friend or 
family member may communicate with the patient. The 
cameras and monitors at both the robot and remote control 
5 stations allow for teleconferencing between the patient and 
the person at the remote station (s) . 

The robot 12 can be maneuvered through the home or 
facility by manipulating the input device 32 at a remote 
Station 16- 

The robot 10 may be controlled by a number of different 
users. TO accommodate for this the robot may have an 
arbitration system. The arbitration system may be 
integrated into the operating system of the robot 12. For 
example, the arbitration technique may be embedded into the 
15 operating system of the high-level controller 50. 

By way of example, the users may be divided into 
classes that include the robot itself, a local user, a 
caregiver, a doctor, a family member, or a service 
provider. The robot 12 may override input commands that 
20 conflict with robot operation. For example, if the robot 
runs into a wall, the system may ignore all additional 

BJY/wrj 
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commands to continue in the direction of the wall. A local 
user is a person who is physically present with the robot. 
The robot could have an input device that allows local 
operation. For exan^le, the robot may incorporate a voice 
recognition system that receives and interprets audible 
commands . 

A caregiver is someone who remotely monitors the 
patient, A doctor is a medical professional who can 
remotely control the robot and also access medical files 
contained in the robot memory. The family and service 
users remotely access the robot. The service user may 
service the system such as by upgrading software, or 
setting operational parameters. 

Message packets may be transmitted between a robot 12 
and a remote station 16. The packets provide commands and 
feedback. Each packet may have multiple fields. By way of 
example, a packet may include an ID field a forward speed 
field, an angular speed field, a stop field, a bumper 
field, a sensor range field, a configuration field, a text 
0 field and a debug field. 
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The identification of remote users can be set in an ID 
field of the information that is transmitted from the 
remote control station 16 to the robot 12. For example, a 
user may enter a user ID into a setup table in the 
5 application software run by the remote control station 16, 
The user ID is then sent with each message transmitted to 
the robot. 

The robot 12 may operate in one of two different modes; 
an exclusive mode, or a sharing mode. In the exclusive 

10 mode only one user has access control of the robot. The 

exclusive mode may have a priority assigned to each type of 
user. By way of example, the priority may be in order of 
local, doctor, caregiver, family and then service user. In 
the sharing mode two or more users may share access with 

15 the robot. For example, a caregiver may have access to the 
robot, the caregiver may then enter the sharing mode to 
. allow a doctor to also access the robot. Both the 
caregiver and the doctor can conduct a simultaneous tele- 
conference with the patient. 

20 The arbitration scheme may have one of four mechanisms; 

notification, timeouts, queue and call back. The 
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notification mechanism may inform either a present user or 
a requesting user that another user has, or wants, access 
to the robot. The timeout mechanism gives certain types of 
users a prescribed amount of time to finish access to the 
5 robot. The queue mechanism is an orderly waiting list for 
access to the robot. The call back mechanism informs a 
user that the robot can be accessed. By way of example, a 
family user may receive an e-mail message that the robot is 
free for usage. Tables 1 and 2, show how the mechanisms 
10 resolve access request from the various users. 
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Table I 



User 


Access 


Medical 


Command 


Software/Debug 


Set 




Control 


Record 


Override 


Access 


Priority 


Robot 


No 


No 


Yes (1) 


No 


No 


Local 


No 


No 


Yes (2) 


No 


No 


Caregiver 


Yes 


Yes 


Yes (3) 


No 


No 


Doctor 


No 


Yes 


No 


No 


No 


Family 


No 


No 


No 


No 


No 


Service 


Yes 


No 


Yes 


Yes 


Yes 



Table II 





Requesting User 


Local 


Caregiver 


Doctor 


Family 


Service 


Current User 


Local 


Not Allowed 


-Warn current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- Set timeout 


-Warn current user of 
pending user • 
-Notify requesting user 
that system is in use 
- Set timeout=5m 


-Wam current user of 
pending user 
-Notify requesting user 
that system is in use 

- Set timeout=5m 

- Call back 


-Warn current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- No timeout 
-Callback 


Caregiver 


-Warn current user 
of pending user. 
-Notify requesting 
user that system is 
in use. 

- Release control 


Not Allowed 


-Warn current user of 
pending user 
-Notify requesting user 
that system is in use 

- Set timeout=5m 

- Queue or callback 


-Wam current user of 
pending user 
-Notify requesting user 
that system is in use 
- Set timeout^Sm 


-Wam current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- No timeout 

- Callback 


Doctor 


-Warn current user 
of pending user 
-Notify requesting 
user that system is 
in use 

- Release control 


-Warn current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- Set timeout=5m 


-Warn current user of 
pending user 
-Notify requesting user 
that system is in use 
- No timeout 
-Callback 


-Notify requesting user 
that system is in use 

- No timeout 

- Queue or callback 


-Wam current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- No timeout 

- Callback 


Family 


-Warn current user 
of pending user 
-Notify requesting 
user that system is 
in use 

- Release Control 


-Notify requesting 
user that system is in 
use 

- No timeout 

- Put in queue or 
callback 


-Warn current user of 
pending user 
-Notify requesting user 
that system is in use 
-Settimeout=lm 


-Wam current user of 
pending user 
-Notify requesting user 
that system is in use 

- Set timeout=5m 

- Queue or callback 


-Wam current user of 
pending user 
-Notify requesting 
user that system is in 
use 

- No timeout 

- Callback 


Service 


-Warn current user 
of pending user 
-Notify requesting 
user that system is 
in use 

- No timeout 


-Notify requesting 
user that system is in 
use 

- No timeout 
-Callback 


-Warn current user of 
request 

-Notify requesting user 
that system is in use 
- No timeout 
-Callback 


-Wam current user of 
pending user 
-Notify requesting user 
that system is in use 

- No timeout 

- Queue or callback 


Not Allowed 
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The information transmitted between the station 16 and 
the robot 12 may be encrypted. Additionally, the user may 
have to enter a password to enter the system 10 . A 
5 selected robot is then given an electronic key by the 
station 16. The robot 12 validates the key and returns 
another key to the station 16. The keys are used to 
encrypt information transmitted in the session. 

Figure 9 shows a system with a plurality of remote 

10 stations 16A, 16B and 16C that can access a robot 12 

through a network 18. The system can be set into an active 
plus observational mode wherein one primary remote station 
16A controls movement of the robot and receives both audio 
and visual information from the robot camera and speaker, 

15 respectively. The secondary stations 16B and 16C also 
receive audio and visual information transmitted between 
the robot 12 and the station 16A. This mode allows 
multiple users at stations 16B and 16C to observe use of 
the robot while a teacher or master at station 16A moves 

20 the robot. 
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The observational mode can be set through a graphical 
user interface of the primary remote station 16A. The 
primary remote station 16A can retransmit the audio/visual 
information received from the robot 12 to the secondary 
5 stations 16B and 16C. This can be done by changing the 

ID(s) in the ID field of the data packets received from the 
robot and then retransmitting the packets to the secondary 
stations. Alternatively, the primary remote station 16A 
can instruct the robot to transmit the audio and visual 

10 information to the primary 16A, and the secondary 16B and 
16C remote stations. It being understood that each remote 
station 16A, 16B and 16C has a unique network identifier 
such as an IP address that allows the robot to direct 
information to each station. The packets may contain a 

15 BROADCAST field that contains the station IDs for the 

remote stations that are to receive packets from the robot. 
The BROADCAST field may be filled by the primary station 
16A. 

The active plus observational mode allows for training 
20 through the robot. For example, the primary remote station 
16A may be operated by a nurse who moves the robot into 
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visual and audio contact with a patient. The secondary 
remote stations 16B an 16C may be manned by personnel that 
observe and receive instructional training on providing 
care giving to the patient. Although instruction of 
5 medical personnel is described, the system can be used to 
train any group of users that are remotely located from a 
training area. For example, the system may be used to 
train personnel at a department store. 

Figure 10 shows a robot head 200 that can both pivot 

10 and spin the camera 38 and the monitor 40. The robot head 
200 can be similar to the robot 12 but without the platform 
110. The robot head 200 may have the same mechanisms and 
parts to both pivot the camera 38 and monitor 40 about the 
pivot axis 4, and spin the camera 38 and monitor 40 about 

15 the spin axis 5. The pivot axis may intersect the spin 
axis. . Having a robot head 200 that both pivots and spins 
provides a wide viewing area. The robot head 200 may be in 
the system either with or instead of the mobile robot 12 . 

While certain exemplary embodiments have been described 

20 and shown in the accompanying drawings, it is to be 

understood that such embodiments are merely illustrative of 
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and not restrictive on the broad invention, and that this 
invention not be limited to the specific constructions and 
arrangements shown and described, since various other 
modifications may occur to those ordinarily skilled in the 
5 art . 
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